Domain Adaptation Without Source Data

نویسندگان

چکیده

Domain adaptation assumes that samples from source and target domains are freely accessible during a training phase. However, such an assumption is rarely plausible in the real world possibly causes data privacy issues, especially when label of domain can be sensitive attribute as identifier. To avoid accessing could contain information, we introduce free (SFDA). Our key idea to leverage pretrained model progressively update self-learning manner. We observe with lower self-entropy measured by more likely classified correctly. From this, select reliable criterion define these class prototypes. then assign pseudolabels for every sample based on similarity score further propose point-to-set distance-based filtering, which does not require any tunable hyperparameters reduce uncertainty pseudolabeling process. Finally, train filtered regularization model. Surprisingly, without direct usage labeled samples, our SFDA outperforms conventional methods benchmark datasets. Impact Statement—This study addresses issue, unsupervised adaptation. Based privacy-preserving adaptation, various stakeholders, including enterprises government organizations, concern about issues their dataset. Furthermore, proposed data-free approach contribute creating positive social impact, large-scale Recently, since size across fields has been scaling up, it almost incapable individual researchers directly utilize large scale training. For this reason, new trend sharing models, e.g., EfficientNet BERT, led global huge amount resources rising up. viewpoint, thus enables people participate field specifically attributes.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Domain Independent Authorship Attribution without Domain Adaptation

Automatic authorship attribution, by its nature, is much more advantageous if it is domain (i.e., topic and/or genre) independent. That is, many real world problems that require authorship attribution may not have in-domain training data readily available. However, most previous work based on machine learning techniques focused only on in-domain text for authorship attribution. In this paper, w...

متن کامل

A survey of multi-source domain adaptation

In many machine learning algorithms, a major assumption is that the training and the test samples are in the same feature space and have the same distribution. However, for many real applications this assumption does not hold. In this paper, we survey the problem where the training samples and the test samples are from different distributions. This problem can be referred as domain adaptation. ...

متن کامل

Multi-Source Domain Adaptation: A Causal View

This paper is concerned with the problem of domain adaptation with multiple sources from a causal point of view. In particular, we use causal models to represent the relationship between the features X and class label Y , and consider possible situations where different modules of the causal model change with the domain. In each situation, we investigate what knowledge is appropriate to transfe...

متن کامل

Fast Domain Adaptation of SMT models without in-Domain Parallel Data

We address a challenging problem frequently faced by MT service providers: creating a domainspecific system based on a purely source-monolingual sample of text from the domain. We solve this problem by introducing methods for domain adaptation requiring no in-domain parallel data. Our approach yields results comparable to state-of-the-art systems optimized on an in-domain parallel set with a dr...

متن کامل

Domain-specific conflict adaptation without feature repetitions.

An influential account of how cognitive control deals with conflicting sources of information holds that conflict is monitored by a module that automatically recruits attention to resolve the conflict. This leads to reduced effects of conflict on the subsequent trial, a phenomenon termed conflict adaptation. A prominent question is whether control processes are domain specific--that is, recruit...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE transactions on artificial intelligence

سال: 2021

ISSN: ['2691-4581']

DOI: https://doi.org/10.1109/tai.2021.3110179